-
Notifications
You must be signed in to change notification settings - Fork 2.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[GPU] Move event completion wait to first of execute_impl #23363
[GPU] Move event completion wait to first of execute_impl #23363
Conversation
Could you please check the performance of loop models? thanks. |
There is no performance regression in the target model. Thanks! |
// Wait for event completion | ||
for (auto& e : events) { | ||
e->wait(); | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I believe this will cause regression..
I guess that the target issue is the event of "execution condition" right?
then I think we need to wait for only that event specifically, not for all events..
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I updated the event wait for only execution_condition. Thanks!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@yeonbok No performance regression in several loop including models. Thanks!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I will review it again after the code fixing.
I updated it! Thanks! |
…olkit#23363) ### Details: - Move event completion wait to first of execute_impl ### Tickets: - 129373
…olkit#23363) ### Details: - Move event completion wait to first of execute_impl ### Tickets: - 129373
…olkit#23363) ### Details: - Move event completion wait to first of execute_impl ### Tickets: - 129373
Details:
Tickets: